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Abstract 

Based on the complete-lattice approach, a new Lagrangian duality theory for 
set-valued optimization problems is presented. In contrast to previous approaches, 
set-valued versions for the known scalar formulas involving infimum and supremum 
are obtained. In particular, a strong duality theorem, which includes the existence 
of the dual solution, is given under very weak assumptions: The ordering cone 
may have an empty interior or may not be pointed. "Saddle sets" replace the usual 
notion of saddle points for the Lagrangian, and this concept is proven to be sufficient 
to show the equivalence between the existence of primal/dual solutions and strong 
duality on the one hand and the existence of a saddle set for the Lagrangian on the 
other hand. 
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1 Introduction 



This paper is concerned with a Lagrange duahty theory for convex set- valued optimization 
with a set- valued constraint. In particular, a strong duality theorem is given, new concepts 
for saddle points in the set- valued framework are introduced and the relationship between 
primal/dual solutions and saddle points is established. The Lagrangian involves a set- 
valued analog of continuous linear functions generated by a pair of continuous linear 
functionals. This is a new construction and different from almost all known approaches 
since it is most common to use continuous linear operators as dual variables. Another 
important new feature is that our results involve (attained) infima/suprema with respect 
to set relations rather than only minimal/maximal elements. The theory given in [25] is 
extended in several directions. Most notably, we do not assume that the ordering cone 
in the original image space has a non-empty interior. The main results also establish a 
one-to-one relationship between the set-valued problem and a corresponding problem for 
a family of scalarizations - despite the fact that we do not rely on so-called weak solutions. 

Optimization problems with constraints given by set- valued functions ("correspon- 
dences", "relations", "multi- valued mappings") have been considered, for example, al- 
ready in the late 70ies and early 80ies in a rather general framework. Compare the papers 
[Ij, [3], [2] and [28], [29]. The objective function was assumed to be extended real- valued 
or vector- valued (in [2]) or even set- valued (in [3]). 

Duality theory for vector problems attracted attention to set- valued optimization prob- 
lems, see [M], [6], [27]. The paper [M] is particularly interesting since the authors defined 
a set- valued Lagrangian for a vector-valued problem: The Lagrangian is defined as a (neg- 
ative) conjugate of a perturbation function with respect to the perturbation variable, and 
the supremum involved in the definition of the conjugate is replaced by a set of maximal 
points. A similar approach for a problem with a set- valued objective can be found in [30] . 
In [33], a generalization of the supremum in IR to a set- valued framework is used which 
later turned out to be a supremum in the sense of a complete lattice, compare [26] . 

The introduction of so-called set relations (extensions of vector preorders to the power 
set of a preordered vector space) led to new solution concepts for set-valued optimization 
problems, see [22], [201 E], [ISj, [I9]. It has been pointed out by the authors of the 
present paper that set relations become even more valuable if they are used to construct 
appropriate image spaces for set-valued functions which carry the structure of complete 
lattices, see [TD], [23], [H], [25]. We obtain meaningful analogs to scalar formulas involving 
an infimum or a supremum. This feature is lacking in any vector optimization (duality) 
theory known to the authors and also in the set relation approach used in [9] , [H], [16] 
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where the aim is to find minimal elements in a set of sets with respect to a set relation. 
See also [5] for a discussion of Lagrange duality results in vector optimization with a 
set- valued objective. 

The paper is organized as follows. In the next section, image spaces for set-valued 
functions are introduced, the basic problem is formulated and its Lagrangian defined. 
In the following sections, our solution concept for set-valued optimization problems is 
introduced, Fenchel conjugates are recalled and a scalarization concept is presented. The 
main results are contained in section El Saddle point results can be found in section [71 
and the appendix contains a definition of the concept " conlinear space" . 

2 Problem formulation, notation 

Let Z be a topological linear space and C C Z a convex cone with G C. We write 
Zi <c -22 for Z2 — Zi & C with -21,-22 ^ Z which defines a refiexive and transitive relation 
(a preorder). The relation <c on Z can be extended to the powerset V{Z) of Z, the 
set of all subsets of Z including the empty set 0, in two canonical ways (see [H] and the 
references therein). This gives rise to consider the following subsets of V (Z): 

T {Z, C) = {AeV{Z) \A = c\{A + C)] 
g {Z, C) = {AeV{Z) \A = clco {A + C)} . 

We shall abbreviate {Z, C) and Q {Z, C) to {C) and Q (C), respectively. 

The Minkowski (elementwise) addition for non-empty subsets of Z is extended to 
V{Z)hy 

0+A= A+0=0 

for A G V{Z). Using this, we define an associative and commutative binary operation 
©: J^(C) X J^(C) J^(C) by 

A®B = c\[A + B) (2.1) 

for A, S G T (C). The element-wise multiplication of a set A C Z with a (non- negative) 
real number is extended by 

0-A = c\C, t-^ = ^ 

for all A G J-" (C) and t > 0. In particular, ■ = cl C by definition, and we will drop the 
• in most cases. The triple (J-'(C) , ©, ■) is a conlinear space with neutral element clC, 
and, obviously, {Q (C) , ©, ■) is a conlinear subspace of it (see appendix for definitions). 
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On T (C) and Q (C), 3 is a partial order which is compatible with the algebraic oper- 
ations just introduced. Thus, [T (C) , ©, ■, ^) and (C) , ©, ■, 3) are partially ordered, 
conlinear spaces in the sense of [10], [H]. This property does not depend on properties 
of the cone C, in particular, <c does not need to be a partial order. The use of 3 can 
be motivated by considering equivalence classes of an extension of the reflexive transitive 
relation on Z generated by C to the power set of Z. Compare [10], [11] for more details. 

Moreover, the pairs (J^(C) , 3), (C) , 3) are complete lattices. If 7^ ^ C T {C\ 
^ ^ E (C), the following formulas hold true: 

inf ^ = cl 1 J A, sup A = C\ A 



and 



inf i3 = clco[JS, sup E=C\B. 



If ^ = we set inf(jF(c)^3) ^ = and sup(-jr(c) 3) ^ = Z. This is in accordance with the 
following monotonicity property: If A\ C A2 then inf A\ C inf A^ and sup A\ ^ sup ^2 
in T {C\ Likewise in Q (C). 

Let X^Y be two locally convex spaces with topological duals X*,y*, and D C y a 
convex cone. The sets T (D) = T {Y^ D) and Q (D) = Q (Y, D) are defined in the same 
way as J-" (C) and Q (C). 

Finally, let /: X — )■ J-" (C) and (7: X — )■ J^{D) be two functions. We are interested in 
the problem 

minimize / subject to G {x) . (P) 
The minimization is understood as looking for 

p= inf {/(x) 0G(7(a:)} = cl |J / (x) , 

{xGX I OGg(x)} 

and a subset of minimizers in which this infimum is attained. A definition for the at- 
tainment of the infimum and a corresponding solution concept is given below. Likewise 
for functions mapping into Q (C). This approach is different from most other approaches 
using a set relation such as [20| [T3] which only focus on minimality notions. 

To simplify our notation, we will drop the space and the order relations in expressions 
like inf(jF(c)^3) {/ [x] | x G X, G (x)} in most cases below. By convention, an infimum 
is defined through the image space of the function: If / maps into J-" (C), then the infimum 
is taken in (J-" (C) , ^) and so on. 
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Remark 2.1 Since g{x) & (D) for each x & X we have 

Oeg{x) <^ g{x)n-D 

Already in it is shown that most of the common forms of constraints in the form of 
inequalities and equations (and many more) can be expressed in the above form. One may 
also compare chapter 5 of Wi 



The positive dual (polar) cone of C is C"*" = {z* G : G C | < (2)}, and the 
negative dual is C" = -C+. We set S {z*) = G Z | < (z)} for z* G Z* . 
Using the set- valued functions 

y^S(y,,,,){y) = {zeZ\y* {y)<z*{z)} 

we define the Lagrangian I: X xY* x C+\ {0} — )• (C) of the problem (P) by 

l{x,y*,z*) = fix)® U S^y*,.,)iy) = f{x)® mi {S^r,,,)iy):yeg{x)}. (2.2) 

If g (x) = 0, then the infimum over y & g (x) = is the empty set. The rules for the 
addition in {Q (C) , ©) (A © = for each A e G (C)) produce / (x, y\ z*) = in this 
case. 

Note that the functions S{^y*,z*) '■ Y ^ V (Z) are positively homogeneous, additive with 
S{y,z*) (0) = S {z*), and they map into Q (C) if and only if z* G C+. If z* = 0, then 
S{y*,z*) (y) £ {Z,0}, and otherwise S(^y*^z*-) (y) is a closed half space. In [TT], it is shown 
that these functions provide a suitable substitute for continuous linear functions within 
the set-valued framework, and they have been applied in [25j to obtain set- valued duality 
results for vector optimization problems (chapter 3, "duality of type 11"). 

Under a mild condition, the primal problem can be reconstructed from the Lagrangian. 

Proposition 2.2 (reconstruction of the primal) If f (x) G Q (C), g (x) E Q (D) and 

f (x) 7^ Z for each x E X , then 

u * *N n u * *\ / : G ^(x) 

sup l{x,y ,z)= l{x,y ,z) = < n ^ ^ ^ 

(r,.*)ey*xcn{o} (,*,..)ey-xcn{o} I ^ ■■ ^^di^) 

Proof. First, assume G 5'(x). Then 

sup l{x,y*,z*)^ sup f {x) Q) S (z*) 

{y*,z*)eY*xC+\{0} (j/*,z*)ey*xC+\{0} 

= n f{^)®s{z*)=f{x) 

z*ec+\{o} 
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since / maps into Q (C) and therefore / {x) is the intersection of all closed half spaces 
containing it. On the other hand, 

sup l{x,y*,z*)C [| l(x,0,z*) 

= n f{x)(BS{z*) = f{x) 
z*ec+\{o} 

since S'(o,2*) (y) = S (z*) and / maps into Q (C). 

Next, assume ^ g{x). Since g (x) is closed and convex, a separation argument 
produces y* eY*\ {0} such that 

inf y*{y)>0. 

This implies lim inf^g„(2.) {ny*) (y) = +00, hence for each z* G {0} 

n— >-oo 

fl (/(x)©cl U 



smce 

M S^nr,.'){y)^\zeZ: inf (ny*) (y) < z* (z) 
y^9{x) 

This completes the proof. □ 



Remark 2.3 The condition / (x) G ^ (C), g (x) & Q (D) for all x & X could be under- 
stood as a well-posedness condition for the problem. If it is violated, then the transition 
from the original problem to its Lagrangian form results in a loss of information - or one 
agrees to replace the original problem by 

minimize cl co / (x) subject to G cl co (7 (x) . 

3 Solutions for set-valued optimization problems and 
canonical extensions 

In this section, we introduce a solution concept for complete lattice-valued problems as 
well as saddle points for corresponding bi- variable functions. Let / : X — £ be a function 
with values in a complete lattice (£, <). Consider the two optimization problems 

minimize f : X C w.r.t. < over X, {£^min) 
maximize f: X ^ C w.r.t. < over X. {Cmax) 
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The sets of minimal and maximal elements of a subset A C C are defined as usual by 

Min A = {z e A \ {y e AAy < z) =^ V = z} , 
Max A = {z e A \ {yeAAy>z) =^ y = z} . 

Moreover, for a set M C X we denote the collection of all values of / over M by 

f[M] = {f{x)\xeM}<ZC. 

A solution of {Cmin)i for example, is expected to satisfy some minimality condition. On 
the other hand, one also expects the infimum of / to be attained at a solution. In contrast 
to the set of extended real numbers, these two requirements do not coincide in a general 
complete lattice. The next definition deals with minimal and maximal function values. 

Definition 3.1 An element x ^ X is called a minimizer of f if f (x) G Min / [X], and it 
is called a maximizer of f if f {x) G Max / [X\ . 

Next, we deal with the attainment of the infimum/supremum. 

Definition 3.2 A set X C X zs called an infimizer of f if 

inf /(x)= inf /(x), (3.1) 

and in this case, we say that the infimum of f is attained in X. Likewise, a set X C X 
is called a supremizer of f if 

sup / (x) = sup / (x) , (3.2) 

and in this case, we say that the supremum of f is attained in X. 

One cannot expect that an infimizer or supremizer is a singleton. Indeed, if, for 
example, we consider a function / into the complete lattice (J-'(C) , ^), the infimum is 
given by the closure of the union of the function values which is not a function value itself 
in general. Therefore, we agree that a solution of (£mm) should be a subset of X rather 
than a single element. This is the point of the following definition which is essentially due 

to [m. 

Definition 3.3 An infimizer X C X of f is called a solution to (\Cmin\j if f C 
Min / [X] , and it is called a full solution if f [X] = Min / [X] . Similarly, a supremizer 
X C X of f is called a solution to (Cjnax) if f [^] — Max / [X], and it is called a full 
solution z/ / [X] = Max / [X] . 
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Clearly, a solution to ( |£m.mD is an infimizer which consists of only minimizers. Note 



that the earliest approach to set-valued optimization problems consisted in looking for 
minimal points of the union of all function values, see [6], [27], for example. Thus, one 
could understand this as looking for a minimal element of the infimum. On the other hand, 
the set relation approach as presented for instance in [201 [IS] aims at finding minimizers 
with respect to a set relation without caring for the infimum. 

Remark 3.4 Note that a solution in the sense of Definition \3. 3\ above is called "mild so- 
lution" in J77| / and I25^ and a full solution is just called "solution" in these references. We 
decided to change the notation since, in particular, in linear vector optimization problems 
one wants to have that a solution consists of finitely many elements. 

Example 3.5 Let the objective function f:JR^Q (1R^,1R^) be defined by 

f{x) = {ze'\Rl\zi>3 + 2x + r, Z2 > 3 + 2x - r, re [-x\ x^] } 

for X G 1R+ and f (x) = for x ^ 1R+. The set X = {0} U (2,3] is a full solution 
to i\Cmin\) , o-nd the set X = {0,3} is a solution to (\Cmin\l - This example shows that a 



full solution may entail a far larger set X than being required for the attainment of the 
infimum. 

The above solution concept can also be expressed in terms of the canonical extension 
of the function /. We introduce this concept below since we will make use of it when 
discussing saddle points. 

Definition 3.6 Let f: X ^ C be a function with values in the complete lattice (£, <). 
The function F: V {X) — )■ C defined by 

F (M) = inf / (x) 

is called the (canonical) inf-extension of f , whereas the function F : V {X) — )■ C defined 
by 

F (M) = sup / (x) 
is called the (canonical) sup-extension of f . 

Clearly, a set X C X is an infimizer of / if and only if the inf-extension F of f attains 
its infimum in X, that is 

F(X)= inf F(M), 
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and likewise for the supremum of F. Therefore, the inf-extension will play a role for 
the minimization problem (£mm) and the sup-extension for the maximization problem 

We turn to the definition of saddle points for a function I: X x V ^ C. The following 
definition extends the concept of canonical extensions to such functions. Note that there 
are two such extensions which seems natural since one can consider "inf sup" as well as 
"sup inf". 

Definition 3.7 Let I: X x V C be a function. The lower canonical extension of I is 
the function L: V (X) x V (V) C defined by 

L {U, W) = sup inf / {x, v) . 

The upper canonical extension of I is the function L : V {X) x V {V) L defined by 

L {U, W) = inf sup / (x, v) . 

The very definitions of L, L immediately produce 

yu ev{x),yw ev (v) l{u,w)<l {u, w) . (3.3) 
4 Fenchel conjugates for set-valued functions 

Given x* G X* and z* G the (conlinear) function S'(^.*^2.) : X G{C) is defined as its 
corresponding version on Y: S(^x*^z*) {^) = ^ Z \ x* (x) < z* (z)} for x E X. 

The (negative) Fenchel conjugate of a function / : X —> V {Z) is the function — /* : X* x 
{0}) ^ g{C) defined by 

- /* (x*, z*) = cl U [/ (^) + (-^)] • (4-1) 

See [11] for more details about and a motivation for this definition. We immediately 
conclude the Young-Fenchel inequality for set-valued functions 

Wz* G C+\ {0} , Vx G X, Vx* ex*: - f* (x*, z*) ^ / (x) + (-x) . (4.2) 

Note that the values of — /* are closed half spaces or or Z. The main result about 
Fenchel conjugates is the Fenchel-Moreau theorem which establishes conditions under 
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which the biconjugate of a function / coincides with /. The biconjugate /**: X Q{C) 
of / : X — Q{C) is given by 



x'ex", z*G{c+\{o}) 
The graph of a function f : X V (Z) is the set 

graph / = {{x,z) eX x Z\zE f (x)} C X x Z. 

A function / : X ^ V {Z , C) is called convex if its graph is a convex set. This is equivalent 
to 

Vxi, X2 G X, Vt G (0, 1) : / (tei + {l-t) X2) 3 tf {x,) + (1 - t) / (xs) • 
We define the closure cl / of / by 

z G (cl /) (x) <^ (x, z) G cl (graph /) . 

With this definition, we can state the Fenchel-Moreau theorem in the following form. 

Theorem 4.1 Let f: X ^ S^C) be a convex function such that there is Xq E X with 
f{xo) ^ ^ and (cl/) (x) ^ Z for all x e X. Then cl / = /**. 

Proof. See [II], Theorem 3. □ 

5 Linear scalarization and the scalarized problems 

Again, under some well-posedness assumptions, a function f : X V (Z) and the set- 
valued problem (P) can equivalently be described by families of extended real-valued 
functions and scalar problems, respectively. The scalarization approach has been used 
as the main tool for obtaining set-valued duality results of Fenchel type along with a 
complete calculus for set- valued convex functions in [3l], see also [I3] and [32]. The set- 
valued approach to vector optimization summarized in [25] also relies on a scalarization 
procedure. Here, we additionally show the equipollence of the set-valued results with 
corresponding results for families of scalarizations. 

5.1 Scalarization of ^(C)-valued functions 

Let a function /: X — )■ V (Z) and z* G C'^ be given. Define an extended real- valued 
function 9?/^^. : X -)• IR = IR U {±00} by 



/** (x) 



n 



[-/* {x*,z*) + (x)] . 



>* i^) = inf ^ z* (z) . 



(5.1) 
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The set- valued function f : X ^ ^(C*) is convex if and only if ff^z* : X ^ ]R is convex 
for each z* G C'^. Of course, (pf^z* i^) is nothing else than the value of negative support 
function of the set / (x) at — z*, but we shall emphasize the dependence on x rather 
than on z*. The support function interpretation of ^Pf,z* immediately gives the following 
formula. If / : X — )■ (C) is convex, then / (x) G Q{C) for all x G X and 

VxGX:/(x)= fl {zeZ\iff,,*{x)<z*{z)}. (5.2) 
z*ec+\{o} 

This is a consequence of the separation theorem since the closed convex set / [x) is the 
intersection of all closed half spaces containing it, and only half spaces with normals 
z* G {0} need to be considered since / (x) G G{C). 

Likewise, the extended real-valued functions fg^y* : X — )■ IR with y* G D'^\ {0} are 
defined for the set- valued function g: X ^ '^{D). 

The next result shows that scalarization and conjugation commute. 

Lemma 5.1 Let f : X ^ V (Z) be a function and x* G X* , z* G C+\ {0}. Then 

{-n{x\^*) = {^^z\-pi,, {x*)<z* {z)] 

where f*fz* = {ff,z*T '■ X ^ ]R is the classical (scalar) Fenchel conjugate of ipf^z*- 

Proof. The proof of the first equation is straightforward from the definitions of 
—'fif^z* and (scalar) Fenchel conjugates. The second is obviously true if / = <(=^ — /* = 
0. If this is not the case, take z G f {x) + S(x*,z*) (— x). Then there are zi G / (x) 
and Z2 G S(^x*,z*) {~x) such that z = Zi + Z2. Using the definition of S(^x*^z*) we obtain 
— X* (x) < z* (2:2). From the definition of ff,z* we get (x) < z* (zi). Hence 

V?/,z* (x) - X* (x) < Z* {Zi + Z2) = z* (z) 

and therefore 

-V^lz* (x*) = inf l^f^z* (x) - X* (x)] < z* (z) . 

This shows U^gx [/ (^) + ^{x'',z*) {-x)] C [z e Z \ (x*) < z* {z)]. Since z* is a 

continuous function, this implies — /* (x*, z*) \^z ^ Z \ —p*f^z* (^*) — (-2)}- 

Conversely, take zq e Z satisfying -V*f,z* i^*) < z* {zq). If zq ^ -f*{x*,z*) there 
would be a ^0 ^ Z*\ {0} such that 

4 (zq) < inf Zq (z) . 

ze-f*{x*,z*) 

Since Zq ^ and — /* ( closed half space with normal z* we can assume, without 

loss of generality, Zq = z* and obtain the contradiction z* {zq) < —'-p\z* (x*) < z* [zq). □ 
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5.2 Scalarization of the optimization problem 



Together with (P) we consider the family of scalar problems 



minimize '■Pf,z* subject to G (x) 



(PS) 



for z* G C^\ {0}, that is we want to find the numbers 



p,, = inf {iff-,, (a;) I G (7 (x)} , ^* G C+\ {0} . 



Together with the Lagrange function for (P) as introduced in (12.21) we consider the La- 
grange function of the scalarized problem 



is called the (scalarized) Lagrangian family of problem (P). One main message of this 
paper is that every Lagrange duality result about (P) can equivalently be expressed in 
terms of its Lagrangian family. 

Proposition 5.2 (Lagrange functions of the scalarized problems) We have 

for allxE X, y* G Y* , z* G C+ . 
Proof. We have 



{x, y*) = tpf^^* (x) + inf y* (y) = ipf^,, (x) + (pg^y* (x) . 



The set of functions 



{A^* (-, ■)\X xY* ^JR: z* e C+\ {0}} 



V^i,z* {x,y*) 



zGl{x,y* ,z*) 



inf z* (z) 



inf z* (z) + 

z<^fix) 



inf 




by calculus rules for support functions and continuity of z*. Since 



.z' (y) = y* (y) 
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by definition of S[y*^z*) we may conclude 

V^i,z* (x, y*) = iff^z* {x) + inf {y* (y) \ y e g (x)} , 

and tlie riglit liand side is just A^. {x,y*). □ 

The previous proposition tells us that the two operations "scalarization" and "transi- 
tion to the Lagrangian" commute. 

Proposition 5.3 (scalarized problems) Let f:X—^ ^(C*) f*^<^ 9- ^ ~^ '^{D). The 

following statements are equivalent for z* G C'^ : 
(a) clco {j{f{x)®S{z*) I e g{x)} ^ Z 
(h) -oo < inf {ipf^^. (x) I e 5^ (a;)} 

Proof. Strainghtforward. □ 



6 Duality 

6.1 Construction of the dual problem and weak duality 

As in scalar optimization, the objective of the dual problem is the infimum of the La- 
grangian with respect to the primal variable, that is the function h:Y*^ C^\ {0} — Q (C) 
defined by 

h{y\z*)=mil{x,y\z*) = d \ \l{x,y\z*). 

x€X 

Since the values of / are closed half spaces, the convex hull can be dropped in the infimum. 
The dual problem, 

maximize h subject to y* eY* , z* E C^\ {0} , (D) 
thus consists in finding 

d= sup hiy*,z*)= n h{y\z*) 

and corresponding (full) solutions. 

The objectives of the scalarized dual problems (see Section 15. 2p are 

inf X,, [x, y*) = inf [v?/,^. (x) + fg^y* (x)] . 
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The scalarized dual problems become 



that is find 



maximize inf A^* (x, ■) subject to y* G Y* , (DS) 



4. = sup <; mf A,* (x, y*) \y*eY*\, z*e C+\ {0} 



and corresponding solutions. 

Proposition 6.1 Scalarization and dualization commute, that is 

'fh,z* (y*) = inf A^. {x,y*) 

for all y* e Y* and z* e C+\ {0}. 

Proof. Straightforward. □ 
The following weak duality result is immediate. 

Proposition 6.2 (weak duality) The following equivalent statements are true: 

(a) For all X e X satisfying G g{x), for all {y*, z*) e Y* x C+\ {0}, 

hiy\z*)Df{x)®S{z*). 

(b) For all X e X satisfying e g [x), for all [y*, z*) eY* x C+\ {0}, 

<^h,z' (y*) = inf z* (z) < inf z* (z) = ^f^,* (x) . 

zeh(y*,z*) z&f{x) 

Proof, (a) is true since for (y*, z*) eY* x C+\ {0} and x E X satisfying Q E g{x) 
we have 

h{y\z*)^f{x)®c\ U 

^ f {x) ® S^y^,,^){Q) = f {x) ® S {z*) . 

The implication (a) ^ (b) is obvious. The converse is also true since h [y*, z*) and / (x) © 
G (z*) are half spaces with normal z* ^ and mfz^f(x) z* {z) = mfz^f(x) z* {z) ® S [z*). □ 
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6.2 Strong duality 

The value function of the basic optimization problem is the function v. Y ^ Q (C) defined 
by 

V (y) = inf {f (x) \ X e X, y e g (x)} . 

Using again the convention that the infimum over an empty set is 0, we obtain v{y) = ^ 
whenever {x E X \ y E g {x)} = ^. Clearly, 

p = v (0) = inf {/ (x) I e 5^ (x)} 

is the optimal value of the original problem. 

The optimal values of the scalarized problems are defined by 

V,, (y) = inf {(^/,,. {x)\yeg{x)}, z* e C+\ {0} . 

Clearly, 

P.* = Vz' (0) = inf {iff^,, {x)\Oeg (x)} , z* E C+\ {0} , 
are the optimal values of the scalarized problems. 

Proposition 6.3 Scalarization and transition to value functions commute, that is 

\/y eY: ip^^^, (y) = inf {ipj^^* (x) \ y E g (x)} = v^* (y) 
with ify^z* : F — )■ IR being the scalarization of the value function. 

Proof. Obvious by construction. □ 
Proposition 6.4 (a) The (negative) Fenchel conjugate of the value function is 

-V* {y\z*) = mf{l{x,-y*,z*)\xEX}, 
and the negative Fenchel conjugate of the value function of the scalarized problem is 

-M*iy*)=mi{X^, (x,-y*)\xEX}. 
(b) V** (0) = d, and {v,*}** (0) = 4* for all z* E C+\ {0}. 
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Proof, (a) We have 

= cl [jl{x,-y*,z*) 
= inf/(x, 

x&X 

(b) Using the definition of h, part (a) and the properties of —v* we obtain 

fl h{y*,z*)= fl cl [jlix,y\z*) 

y*,z* y*,z* x£X 

= n [-v*{-y*,z*) + s^.,.,,.){0)]=v**{0). 

y*,z* 

This completes the proof. □ 

Proposition 6.5 Let f and g be convex and f (0) 7^ Z, v {0) ^ 0. Then, there is z* G 
C+\ {0} such that p © S {z*) = v {0) (B S {z*) ^ Z, and the following statements are 
equivalent: 

(a) p = d, 

(b) V is closed at ^Y, that is (dv) (0) = v (0), 

(c) p,, = 4* for each z* E C+\ {0} with p®S (z*) ^ Z, 

(d) For each z* G C''"\ {0} with p © S {z*) 7^ Z the function y (-> ^p^^^* {y) is closed at 
G y, I.e. cl (<^.,..)(0) = Vv,z* (0). 

Proof. Since / and g are convex, v is convex as well. Moreover, f (0) = p is 
the optimal value of the original problem and a closed convex set. If v (0) ^ {Z, 0}, a 
separation argument produces z* G C^\ {0} such that v {Gi) ® S {z*) 7^ Z. 

The equivalence of (a) and (b) follows from (b) of Proposition 16.41 and the set- valued 
Fenchel-Moreau theorem (Theorem 14.11) . 

The equivalence of (c) and (d) follows likewise, but it is also the known scalar result. 

It remains to prove the equivalence of (a) and (c). The implication (a) ^ (c) follows 
from the definition of d and the scalarization functions. The converse is a consequence 
of the fact that both p and d are closed convex sets, and one can apply formula (15. 2p with 
/ (x) replaced by p and c/, respectively. □ 
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The remaining part of this section is devoted to sufficient conditions for strong duahty, 
or V (0) = V** (0). The following condition is called the Slater condition for problem 
(P): 

3x e dom / : g (x) f] int {-D) ^ 0. 
The implicit assumption is int D 7^ 0. 

Theorem 6.6 (strong duality) Let f and g be convex. If the Slater condition for 
problem (P) is satisfied, then strong duality holds, that is the following two equivalent 
conditions are satisfied: 

p = inf {/ (x) \ E g (x)} = sup h {y*, z*) = d (6.1) 

yeY',z*GC+\{o} 

Wz* e C+\{0} : p,. = inf {v9j,,. (x)\Oeg{x)}= sup ^h,z' (y*) = 4*- (6.2) 

If the infimum of the primal problem is not Z , then the following two equivalent conditions 
are satisfied 

p®S{z*)^Z^ 3y* eY*: p®Siz*) = h{y*,z*) (6.3) 
-00 < p,, 3y* e Y* : p,, = i^h,z' (v*) ■ (6.4) 

Moreover, the set 

A = {{y*, z*) eY*x C+\ {0}\Zy^p(SS (z*) = h (y*, z*)} 

= {{y*, z*) eY*x C+\ {0} I -00 < p,, = ^H,.' (?/*)} 

is non-empty and a full solution of the dual problem. 

The theorem can be summarized as "strong duality holds and is equivalent to strong 
duality for every meaningful scalarized problem" . 

Proof. If p = Z, weak duality implies d = p. Thus let p ^ Z. In view of Proposition 
16.51 we have to show that v (0) = (civ) (0). By Slater's condition there is a neighborhood 
y of e y such that y G (7 (x) 7^ for each y E V. Hence 

viy) = d[j{f{x)\yeg{x)}^f{x)^(D 

for all y & V. Take zq G (cl?;) (0), that is (0, zq) G cl (graphs). Then, for each neighbor- 
hood of G y and each neighborhood [/ of G Z we have 

[(0, zo) + {W X U)] n graph v ^ (/). 
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Fix a neighborhood U of e Z and < t < 1. Then [(0, zq) + (tV x ^7)] fl graphs 7^ 0. 
Take i/o & V and z eU such that (0, ^o) + (^l/O) z) G graphf , and take z E f {x). Then 

(0, Zo) + {tyo, z) e graph A (0, 0) + {-tyo, z) E graph -y. 

The second inclusion is a consequence of / (x) C t) (y) for all y E V since we can assume 
that V is balanced. Taking the convex combination of the two points in graphs with 
s = and 1 — s = we obtain 

^(.„ + .-) + ^.e.(0) 

for all t E [0, 1]. Since v (0) is a closed set by definition, we let f — > and get zq + z E v (0). 
Hence, for each neighborhood U of E Z we have (^o + U) (1 v (0) ^ ^ which implies 
Zq E V (0) since the latter set is closed. This proves that v (0) = (clf) (0) and hence p = d. 

Next, since p E Q (C) \ Z there is z* E C"^\ {0} such that pQ)G (z*) ^ Z, and we have 
p® S (z*) = {z E Z \ Vz* (0) < z* {z)}. Proposition 16.31 implies v^* (0) = Lp^^z* (0), hence 



2; e pes' (2*) <^ ^v,z* i'^) < z* {z) . 

Proposition 15.31 yields that the convex function y — )■ Vz* (y) = ^Pv,z* {y) has a finite value 
at G F. The Slater condition ensures that this function is continuous at G F, hence 
there is y* E Y* such that 

-y* e d^,,z' (0) 

which in turn is equivalent to 

+ (o) = -y* (0) = 

(Young- Fenchel equality for elements of the subdifferential). Finally, observe that 

zE-v*{y\z*) ^ -{^.,z^y{y*)<^*{^)- 
Altogether, we obtain 

zEp®G{z*) ^ (0) < 2* (2) 

^ - [^,^^,y [-y*) < Z* {Z) 

<^ z E -V* {-y*,z*) 
^ zEh{y*,z*) 

where the last equivalence is a consequence of Proposition 16.41 (a). This proves that the 
set A is non-empty. 
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Finally, in view of Definition 13.31 we have to establish the following facts: 

(i) d = f] {h {y* , z*) I {y*, z*) G A} (attainment of the supremum). 

(ii) Each h {y*, z*) with [y* , z*) E A is a maximal element of 

H={h {y\ z*) ^ Z I {y*, z*) eY*x C+\ {0}} 

with respect to ^ (A is a solution since each of its elements is a maximizer). 

(iii) If h {y*, z*) is a maximal element of H, then [y*, z*) G A (A is a full solution since 
all maximizers of the dual problem are elements of A). 

(i) is a direct consequence of strong duality. 

(ii) h {y*, z*) is maximal in H if and only if 

(y*, z*) G F* X C+\ {0} ,hiy\ z*) ^h{y\ z*) ^ /i (y* , z*) = h {y\ z*) . 
If {y*,z*) G A and h{y*,z*) D h{y*, z*), then by weak duality 

h (r , z*) D h (y*, z*)Dp®S (r ) = h{y*, z*) , 

hence h {y*, z*) is maximal in H. 

(iii) Assume h{y*,z*) is maximal in H. Then, there is y* G Y* such that Z ^ 
p Q) S (z*) = h {y* , z*) according to the strong duality theorem. Weak duality implies 

hiy\z*)Dp(BSiz*) = hir,zl, 
hence h{y*,z*) = h {y*, z*) by maximality of h{y*,z*). This proves {y*,z*) e A. □ 

6.3 Strong duality via compactness 

In this subsection, we use a "dual" condition to establish strong duality. 

Theorem 6.7 Let f : X ^ Q (C) and g: X ^ Q (D) be closed. Assume that there are 
Zq G C'^ and y^ G such that the function 

X ^ ipfXa (x) + (x) 

has compact sublevel sets. Then, the value function v (y) = inf {/ (x) \ y & g (x)} is closed. 
If, additionally, f and g are convex, then strong duality holds, i.e. v (0) = p = d. 

Proof. Take a net (?/q,, z^) G graph f which converges to {y, z) x Z. Then, there 
is a net x^ and for each a there is a net zp ^ such that 

Za + Zi3 e f{ Xa) J ya G g (Xq,) . 
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Since / and g have closed convex values, this implies (see (15. 2p ) 



Since and are convergent, there is such that for all a exceeding ao there is 

/3o (a) such that 

'ff,z^ (Xa) + 'fg,y* {Xa) < Zq {Zc, + Zp) + T/q [Vo) < Zq [z) + [y) + 1 

for all /3 exceeding /3o(a). Because of the compact sublevel set assumption, Xa has a 
subnet converging to some x E X. Since / and g are closed, we have z E f (x) and 
y E g (x), hence z E v [y). This proves that v is indeed closed. If v (0) = Z, then d = phy 
weak duality. If the additional convexity assumption is satisfied and v (0) 7^ Z, then v is 
closed convex and (elf) (0) = f (0) = f** (0). Proposition 16.41 (b) implies strong duality. 
□ 

Note that the same proof works if one replaces the function ff,z*+'^g,y* in the compact 
sublevel set assumption by \o'^f,z^ + ^iV9,yo ^^^^ numbers Aq, Ai > 0. The remarkable 
fact is that such an assumption for just one scalarization is enough the ensure strong 
duality. This is in the spirit of [HI Theorem 4.4] and [T2| Theorem 3.9]. On the other 
hand, primal attainment of the solution is a much harder to achieve property which will 
be discussed elsewhere. 

6.4 An example 

We shall consider the following specialization: Let g, A^, M be positive integers and 
X = IRP^, Y = IR*^ Z = IR^ and C = IR^, D = WV^. Moreover, let the matrices 
An G IR*'^^^, n G {1, 2, . . . , A^}, and b G IR*^ be given. The problem we are interested in 
is 

N M 

minimize ^ /„ (x") subject to G ^ Anx" - 6 + (PSep) 

n=l m=l 

for functions /„ : IR^ — )■ Q (IR'^, IR+), n = 1, . . . , A^. The motivation for this problem with 
separated variables comes from utility maximization for vector-valued utility functions. 
One may compare [TJ Chapter 3] for a scalar version and also [U Section 4.3, Example 
4(d)]. 
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The Lagrangian for this problem is 

I {X, V,W) = Y^ fn (X") + ~ ^ ) 

n=l \n=l ) 

N N 

= I] /« (a;") + ^{-Alv,.n) (a;") + (-6) . 



n=l n=l 

Here, by a shght abuse of notation, the dual variables are v G IR*^ w e JRl\ {0}. The 
dual objective becomes 

h{v,w) = inf l{x,v,w) 

N 

= ^(,,^) [b) + inf Yl [f- (^") + (^")] 

n=l 

Af 
n=l ^ 



n=l 



If one defines a function U: H^' g (1R^ IR^) by 



{N M "I 

n=l m=l ^ 



and another one : x 1R!{,\ {0} by 



n=l 



then, in accordance with well-known formulas from scalar utility optimization (see [71 
Chapter 3]) strong duality is nothing else than 

u{h) = [-v{;-)r{-h). 

6.5 Set-valued duality in vector optimization 

In [251 Theorem 3.31, 3.32], Lagrange duality theorems for infimal-set- valued functions 
are given under the assumption that the interior of the ordering cone C is non-empty. 
Here, we show that comparable results can be obtained under a much weaker assumption. 
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Along the way, the relationship between the Fenchel conjugates introduced by [231 1211 
and those by [11] will be clarified. 

Let us assume that there is an element zq G C\ {0} such that 

V^* G C+\ {0} : z* (z) > 0. 

In this case, the set B (zq) = {z* G C+: z* (zq) = 1} is a base of C+ with ^ clB (zq). 
That is, for each z* G {0} there is a unique representation z* = tz^ with t > and 
^0 e B{zo). Compare [8], Definition 2.1.14, Theorem 2.1.15 and 2.2.12 applied to C+ 
instead of C. Clearly, a pointed closed convex cone with non-empty interior has a base, 
and conversely, the cone has an empty interior, but a base is generated by the constant 
1 function. 

The very definition of the functions S(^x*^z*) gives 

I X* G X*, z* G C+\ {0}} = I X* G X*, z*eB (zo)} . 

Therefore, it is sufficient to run an intersection like in the definition of d in Section 16.11 
over y* G Y* and z* ^ B (zq). Moreover, one easily checks (see also Proposition 6 (iv) in 
[lU) for z* eB{zo) 

MxeX: (x) = {x* (x) Zo} + S{z*) . 

Thus, the conjugate of a function f : X ^ V (C) can be written as 

-/* {x\ z*) = cl U [/ {x) - X* (x) z, + S {z*)] = cl IJ [/ (x) - X* (x) Zo] © S {z*) . 

The part which does not depend on z* (remember zq defines a base of and is the same 
for all z* G C"'"\ {0}) has been used in [2l], [26j for a definition of another set- valued 
conjugate, namely 

-/;(^*)=C1 U [/ (X) - X* (X) zo] . 

xex 

If the cone C has non-empty interior and zq G int C, then the space J-" of upper closed 
sets as defined in [25] coincides with J-'(C). In this case, one can derive an infimal set 
version of the Lagrange duality theorem (Theorem 16. 6p in the same way as Theorem 
3.32 is derived from Theorem 3.26 in [25]. Note that under convexity assumptions the 
functions map indeed into Q (C) which is a subset of iC). We omit the details since 
they can be found in [25]. Finally, if Z = IR, C = IR+, then = 1R_|_, and {1} is a base 
of C"*". With this simple device one obtains a scalar version of Theorem 16.61 for example. 
Theorem 4.3.7. in [1]. 
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7 Canonical extensions and saddle points of Lagrangians 



7.1 Saddle points for functions with values in complete lattices 

With a bi- variable function / : X xW ^ C, one can associate two optimization problems, 
namely 

minimize p{x) over x G X and (PI) 
maximize d (w) over w & W (Dl) 

where 

p {x) 
d (w) 

The weak duality relation 

\fx e X, V«; e W: d{w) <p{x) 
follows immediately from f l3.3p . Indeed, for all x G X and all w G W, 

d{w) = L{X,{w})<L{X,W) < L{X,W) <L{{x} ,W)=p{x) . 

In the next definition, saddle points for the function / are introduced. 

Definition 7.1 Let I: X xV ^ C he a function. A pair {X,V) E V {X) x V {V) is 
called a saddle point of I if the following conditions are satisfied: 
(ajdl^p [X] C Minp [X] and dS ^ d [V] C Max d [V] . 
(h) For allU eV (X) and all W E P {V), 

L {X, W) <L {X, V) =L {X, V) <L {U, V) . 

A saddle point is called full if the two inclusions in (a) are equations. 

Condition (b) generalizes the saddle point condition known from scalar optimization. 
Note that (b) also includes the statement that the lower and the upper canonical extension 
of / coincide at the saddle point. In the scalar ) and (b) are equivalent - which is 

no longer true for functions with values in complete lattices. 



= L {{x} , W) = sup I (x, w) , 
= L {X, {w}) = inf / (x, w) . 
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Lemma 7.2 For a pair {X,V) G X V{V), statement (h) m Definition \71\ 

equivalent to 

s\x^d{v)= inf p (x) . (7.1) 

Proof. Assume (b) of Definition (Till With W = V and U = X we obtain 
inf p{x) = L {X, V) <L {X, V) = sup d (v) 

wfiicfi produces " <" in (17. ip according to the definitions of L, L, p and d. On the other 
hand, from the weak duahty relation (13. 3p we obtain 

sup d{v) = L (X, V) <L {X, V) <L {X, V) < L {X, V) = inf p (x) . 

Conversely, assume (El]). Then, ioi U e V (X), W e V {V), 

inf sup / {x, v) < inf sup / {x, v) = sup inf / (x, v) < sup inf / (x, v) 



which produces 



From this, we obtain 



L (X, W) <L {U, V) . 



\/U eV{X):L {U, V) <L {U, V) 
yW eV{V): L {X, W) <L (X, V) 



as well as 



L{X,V)<L{X,V). 
The weak duality relation (13. Sp gives 

L{X,V) <L{X,V), 

and the last four relations together imply (b) of Definition 17.11 □ 
Theorem 7.3 The following statements are equivalent: 

(a) X e V{X) IS a (full) solution of (PI), V E V (W) is a (full) solution of (Dl), and 
strong duality holds. 

(b) {X,V) is a (full) saddle point of I: X xV ^ C. 
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Proof, (a) =^ (b): Since X is a solution of of (PI) and V of (Dl), (a) of Definition 
I7.1l is immediate. Strong duality and the attainment of the infimum/supremum yield 

sup d (v) = sup d (f ) = inf p (x) = inf p (x) , 

vev v£V 

hence Lemma 17.21 produces (b) of Definition I7.1[ 

(b) =^ (a): From (a) of Definition 17.11 we obtain that X is a minimizer of (PI) and V 
a maximizer of (Dl). Lemma [7.21 and weak duality yield 

inf p (x) = sup d (v) < sup d (v) < inf p (x) < inf p (x) , 

xex yizv vgv x&x 

hence X is an infimizer of (PI), V a supremizer of (Dl) and strong duality holds. □ 

7.2 Saddle points of the Lagrangian and strong duality 

In this subsection, we specify the setting of the previous one to the set- valued optimization 
problems introduced in Section |2l In particular, with (£, <) = {Q, ^) and W = Y* x 
C^\ {0} we can define the Lagrangian of problem (P) as the function 

{x,y*,z*)^l{x,y\z*) = fix)® [j 

yGg{a:) 

which depends on the primal variable x E X and the pair of dual variables {y*,z*) G 
Y* X C+\{0}. 

Remark 7.4 Of course, if I is the Lagrangian of problem (P), then, under the assump- 
tion of Proposition [27^ (PI) coincides with (P), and (Dl) coincides with (D) since, by 
definition, d = h in this case. 

The following theorem gives the link between saddle points of the Lagrangian and 
strong duality. 

Theorem 7.5 Let the assumptions of Theorem \6.6\ be satisfied, and let U G V (X) be a 
solution of (P). Then, there exists A e V {Y* x C+\ {0}) such that {U, A) is a saddle 
point of the Lagrangian I. 

Proof. Follows from Theorem [TTSl and Theorem l631 □ 
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8 Appendix 



The following definition is taken from where references and more material about 
structural properties of conlinear spaces can be found. 

Definition 8.1 A nonempty set W together with two algebraic operations +: W x W ^ 
W and ■ : 1R+ x W ^ W is called a conlinear space provided that 
(CI) {W, +) is a commutative monoid with neutral element 9, 

(C2) (i) ^Wi,W2 eW e 1R+; r ■ [wi + W2) = r ■ wi+ r ■ W2, (ii) G W, Vr, s G IR+z 
s ■ {r ■ w) = {rs) ■ w, (Hi) 'iw G W : 1 ■ w = w, (iv) ■ 6 = 6. 

An element vj & W is called a convex element of the conlinear space W if 

Vs, t >0: {s + t)-w = s- w + t- w. 

A conlinear space [W, +, ■) together with a partial order :< onW (a reflexive, antisym- 
metric, transitive relation) is called ordered conlinear space provided that (iv) w,Wi,W2 G 
W , Wi :< W2 imply wi+w ^ W2+W, (v)wi,W2 G W, Wi ^ W2, r G 1R+ imply r-wi < r-W2- 

A non-empty subset V ^ W of the conlinear space {W,-\-,-) is called a conlinear 
subspace of W if (vi) Vi,V2 G V implies Vi -\- V2 & V and (vii) v & V and t > imply 
t-v eV. 

It can easily be checked that a conlinear subspace of a conlinear space again is a 
conlinear space. 
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